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ABSTRACT 

Despite  recent  advances  that  have  been  made  in  expert  system  building 
technologies,  the  process  of  obtaining  knowledge  from  human  experts  and 
coding  it  into  a  computing  system  remains  fraught  with  difficulties.  The 
Knowledge  Acquisition  Tool  (KAT)  currently  being  developed  at  The  BDM 
Corporation  is  designed  to  address  this  knowledge  acquisition  bottleneck  in 
the  domain  of  materials  processing.  KAT  offers  the  knowledge  engineer  a 
variety  of  modes  in  which  to  query  a  materials  expert  on  different  aspects 
of  a  given  materials  domain.  In  the  Clarification  Mode,  the  expert  speci¬ 
fies  the  entire  process  in  terms  of  an  AND/OR  graph.  This  structure  is 
converted  to  a  flowchart  in  the  Prediction  Mode,  where  the  expert  is  asked 
to  predict  problems  that  can  occur  at  different  points  in  the  process  and 
to  specify  limiting  conditions.  Finally,  the  Diagnosis  Mode  provides  a 
dynamic  step-through  of  the  process  model  as  defined  by  the  expert,  so  that 
s/he  can  verify  the  specification  of  the  process  and  redesign  as  necessary. 
Progress  made  thus  far  on  the  KAT  project  includes:  (1)  completion  of  the 
overall  system  design;  (2)  implementation  of  an  initial  version  of  the 
Clarification  Mode;  (3)  partial  completion  of  the  Prediction  Mode;  and 
(4)  detailed  consideration  of  KAT's  generality  to  domains  other  than 
materials  processing. 
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A  KNOWLEDGE  ACQUISITION  TOOL  FOR  THE 
INTELLIGENT  PROCESSING  OF  MATERIALS 

A.  INTRODUCTION  AND  OVERVIEW 


Today's  applications  of  artificial  intelligence  are  based  upon  the 
fact  that  useful  tasks  can  be  accomplished  by  programs  containing  large, 
detailed,  specialized  knowledge  bases.  It  has  become  apparent  that  one  of 
the  major  obstacles  in  applying  artificial  intelligence  to  specialized 
domains  is  the  difficulty  of  creating  these  knowledge  bases,  which  requires 
the  acquisition  of  the  requisite  knowledge  from  human  experts.  This 
knowledge  acquisition  bottleneck  reflects  the  difficulty  of  obtaining 
knowledge  from  domain  experts  in  a  structured  fashion  and  converting  it 
into  a  form  that  can  be  readily  accessed  by  the  expert  system  itself. 
There  have  been  many  recent  advances  in  expert  system  building  technology 
such  as  expert  system  shells,  but  these  advances  do  not  address  the  know¬ 
ledge  acquisition  bottleneck.  Building  the  initial  knowledge  base  remains 
one  of  the  largest  stumbling  blocks  to  successful  system  completion. 

The  typical  approach  to  building  knowledge  bases  for  AI  systems 
entails  prolonged  and  intensive  one-on-one  interactions  between  a  pro¬ 
grammer  and  a  domain  expert.  In  this  setting,  the  programmer  may  elicit 
large  amounts  of  information  from  the  expert,  impose  his  or  her  own  organi¬ 
zation  onto  this  information,  and  encode  it  into  the  system.  An  obvious 
drawback  to  this  approach  is  that  the  programmer  learns  much  more  detail 
about  the  domain  than  is  likely  necessary,  and  the  expert  becomes  far  rtwre 
knowledgeable  about  AI  programming  than  s/he  might  like. 

The  present  Knowledge  Acquisition  Tool  (KAT)  project  is  aimed  at 
investigating  remedies  for  the  knowledge  engineering  problem.  KAT  is  being 
designed  for  use  by  a  programmer  as  a  tool  to  aid  in  the  knowledge  acquisi¬ 
tion  process,  providing  structured  mechanisms  for  eliciting  information 
about  materials  processing.  It  is  in^ortant  to  note  from  the  outset  that 
KAT  will  not  be  used  as  a  tool  for  building  an  expert  system  in  materials 
processing.  Rather,  KAT  will  be  used  by  the  programmer  to  build  up  a 
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knowledge  base  that  can  then  be  handed  over  to  designers  who  will  be 
building  an  expert  system.  Furthermore,  it  is  important  to  realize  that 
although  KAT  will  automate  the  knowledge  engineering  process  to  some 
degree,  it  should  not  be  considered  a  replacement  for  the  knowledge  engi¬ 
neer.  It  is  best  thought  of  as  a  tool  that  the  knowledge  engineer  uses  to 
query  the  expert  in  a  structured  manner.  Such  a  tool  will  constitute  a 
marked  advance  in  the  knowledge  engineering  process. 

Though  KAT  is  not  an  expert  system,  it  is  a  sophisticated  tool 
embodying  the  best  methodologies  known  for  process  specification,  both  in 
top-down  and  bottom-up  fashion.  The  top-down  portion  is  based  on  the 
highly  successful  Higher  Order  Software  approach  (Hamilton  &  Zeldin,  1980; 
h'arel,  1980)  used  in  complex  software  development  for  NASA,  extended 
slightly  to  allow  parallel  processes  (Reeker,  1986).  The  bottom-up  portion 
features  flowcharting  that  can  be  rearranged  dynamically  and  transformed 
back  to  the  top-down  AND/OR  representation. 

KAT  can  be  used  to  extract  knowledge  both  through  explicit  and 
implicit  queries  of  the  expert,  who  will  be  aided  by  the  knowledge  engi¬ 
neer.  Research  in  the  area  of  human  memory  has  suggested  that  procedural 
knowledge  might  best  be  extracted  by  implicit  means  (e.g.,  Graf  &  Schacter, 
1985;  Roediger  4  Blaxton,  1987).  In  specifying  processes,  however,  all 
knowledge  is  not  procedural,  as  a  number  of  declarative  facts  will  be 
germane  to  the  process.  (For  a  discussion  of  the  distinction  between  pro¬ 
cedural  and  declarative  knowledge,  see  Kolers  &  Roediger,  1984.)  For  this 
reason,  KAT  has  been  designed  to  provide  facilities  for  obtaining  both 
types  of  knowledge  in  a  natural  manner. 

As  shown  in  Figure  1,  the  expert  will  interact  with  KAT  in  three 
different  "modes"  called  Clarification,  Prediction,  and  Diagnosis.  These 
modes  will  be  used  iteratively  to  provide  a  structure  for  knowledge  acqui¬ 
sition.  The  Clarification  Mode  (Figure  2)  is  a  framework  that  allows  the 
expert  to  tell  the  system  what  his  or  her  mental  model  of  the  process  is  in 
terms  of  subprocesses.  This  is  the  top-down,  or  process  decomposition 
portion  of  the  knowledge  acquisition  activity.  As  already  mentioned,  the 
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Figure  1.  The  Overall  Structure  of  KAT 
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result  is  an  AND/OR  graph.  '^Ihere  OR  nodes  are  used,  the  branches  will  be 
labeled  by  conditions  that  will  cause  one  alternative  to  be  chose. 

The  I’rediction  Mode  (Figure  3)  orovides  another  view  of  the  model 
built  during  the  Clarification  Mode.  The  knowledge  structure  created 
earlier  will  be  presented  in  such  a  way  as  to  emphasize  the  temporal  flow 
of  the  process,  which  will  expose  "holes"  that  were  previously  missed. 
Time  and  sequencing  relationships  that  may  only  be  implicit  in  the  AND/OR 
representation  are  now  shown  explicitly,  though  the  logical  subsetting 
apparent  in  the  AND/OR  graoh  is  suppressed.  (Although  the  knowledge  struc¬ 
ture  deoicted  in  Figure  3  shows  no  AND/OR  relations,  this  will  not  always 
be  the  case.)  During  this  mode  the  user  will  be  asked  questions  concerning 
particular  conditions  that  must  be  satisfied  in  order  for  the  process  to 
continue.  Various  facilities  for  encoding  this  information  are  being 
developed  and  will  be  discussed  later. 

Once  the  expert  has  iterated  between  the  Clarification  and  Prediction 
Modes  several  times,  a  fairly  well-specified  knowledge  structure  will  be  in 
place  and  the  Diagnosis  Mode  will  be  invoked.  The  Diagnosis  Mode 
(Figure  4)  will  provide  a  means  of  "stepping  through"  the  process  model  in 
a  dynamic  manner.  Where  the  model  is  not  yet  adequately  specified,  this 
mode  will  expose  the  need  for  more  detail.  In  a  sufficiently  knowledge- 
rich  environment,  the  Diagnosis  Mode  could  actually  simulate  the  process 
taking  place,  although  it  has  not  been  designed  to  be  a  simulation  environ¬ 
ment  in  the  normal  sense.  For  a  materials  processing  application,  the 
amount  of  knowledge  required  for  a  simulation  would  be  considerable  and 
would  include  the  sort  of  qualitative  physical  knowledge  studied  by 
De  Kleer  (1984)  and  Kuipers  (1984).  Interest  exists  in  this  aspect  of  KAT 
for  the  future,  but  the  present  Diagnosis  Mode  is  designed  to  do  an  event- 
stepped  "tour"  of  the  process  specified.  In  this  "tour",  the  expert  will 
have  to  verify  that  the  model  is  indeed  reflective  of  the  true  physical 
world. 
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3.  KAT  VERSUS  TRADITIONAL  KNOWLEDGE  ENGINEERING 

The  traditional  approach  to  knowledge  engineering  usually  involves  an 
extended  interviewing  process  whereby  the  knowledge  engineer  asks  the 
expert  as  many  questions  as  possible  about  the  domain  of  interest.  As 
shown  in  Figure  5,  these  questions  are  limited  in  their  utility  in  several 
ways.  First,  the  queries  are  explicitly  formed  and  are  presented  to  the 
expert  in  such  a  manner  as  to  presuppose  a  particular  type  of  response. 
Second,  the  fact  that  the  queries  can  be  posed  at  all  by  the  knowledge 
engineer  implies  that  s/he  has  some  understanding  of  the  domain  and  its 
important  information  elements.  The  knowledge  engineer's  acquisition  of 
this  domain  knowledge  is  not  a  trivial  task.  (After  all,  if  the  domain 
were  easily  understood,  there  would  be  no  need  to  consult  an  expert.)  In 
all  likelihood,  a  large  amount  of  time  will  be  spent  in  coming  up  to  the 
level  of  understanding  that  enables  meaningful  interactions  with  the 
expert. 

The  third  and  most  serious  drawback  to  the  questions  that  the  know¬ 
ledge  engineer  poses  to  the  expert  is  that  they  reflect  the  knowledge  engi¬ 
neer's  own  mental  model  of  the  domain  and  not  the  expert's.  The  knowledge 
engineer  deems  particular  questions  to  be  important  because  they  fill  in 
missing  information  in  his  or  her  personal  conception  of  the  problem 
domain.  Since  the  knowledge  engineer  is  not  experienced  in  this  domain,  it 
is  likely  that  s/he  will  focus  on  concepts  that  are  only  tangential  to  the 
main  issues,  and  will  bias  the  construction  of  the  knowledge  base.  Since 
the  expert  is  not  experienced  in  AI  programming,  s/he  will  not  be  able  to 
look  at  the  knowledge  structure  as  it  is  developed  and  make  corrections  as 
to  the  proper  hierarchical  arrangement  of  knowledge  base  elements.  One 
might  imagine  how  a  few  mistakes  of  this  type  early  in  the  knowledge  acqui¬ 
sition  process  could  lead  to  deeply  entrenched  biases  in  the  knowledge 
structure  that  would  be  difficult  to  compensate  for  at  a  later  time. 

In  contrast  to  this  approach,  KAT  offers  several  modes  in  which  the 
expert  may  be  queried  about  the  domain.  Some  of  these  queries  will  be 
explicit  whereas  others  will  be  implicit.  For  example,  in  the  Prediction 
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Figure  5.  Comparison  of  KAT  With  Traditional  Approaches  to 
Knowledge  Engineering 
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Mode  the  expert  will  be  asked  explicitly  to  identify  sensors  that  are  of 
interest  at  a  particular  point  in  the  process.  In  the  Diagnosis  Mode,  how¬ 
ever,  readings  from  these  sensors  will  be  used  to  make  inferences  con¬ 
cerning  whether  the  process  is  properly  specified.  This  second  type  of 
interaction  involves  what  may  be  termed  an  implicit  query  in  that  the 
expert  is  watching  the  process  in  action  and  redesigning  as  necessary, 
rather  than  responding  to  overt  questions  from  the  knowledge  engineer. 

A  second  class  of  problems  that  one  encounters  when  using  traditional 
approaches  to  knowledge  engineering  involves  the  recoding  of  the  infor¬ 
mation  provided  in  the  expert's  responses  to  a  form  that  the  AI  system  can 
use.  In  most  cases,  the  expert  is  interviewed  at  length  at  some  place 
other  than  the  software  development  site.  Following  an  interview  session, 
the  knowledge  engineer  has  to  work  through  and  organize  the  information 
gleaned  during  the  interview  and  decide  how  best  to  encode  it  into  the 
already  existing  knowledge  structure.  Since  the  expert  is  not  present  when 
this  recoding  takes  place,  the  knowledge  engineer  runs  the  risk  of  either 
omitting  important  information,  coding  the  information  into  an  inappropri¬ 
ate  form,  or  both. 

KAT  is  designed  to  avoid  these  recoding  problems.  Specifically,  since 
the  knowledge  engineer  will  be  using  KAT  directly  during  the  knowledge 
acquisition  process,  the  information  gathered  from  the  expert  may  be 
directly  encoded  into  the  knowledge  base  as  it  is  elicited.  Furthermore, 
the  queries  posed  by  the  system  will  be  designed  in  such  a  way  that  their 
answers  will  naturally  fit  into  a  particular  data  structure  format.  That 
is,  the  system  will  already  be  expecting  that  a  response  to  a  particular 
question  will  take  the  form  of  a  rule  (or  a  frame,  as  the  case  may  be). 
Facilities  for  entering  the  information  into  the  system  will  be  available 
to  automate  this  process  as  much  as  possible.  Thus,  errors  resulting  from 
miscoding  may  be  more  easily  avoided.  Finally,  since  the  expert  will  be 
present  when  the  information  is  entered  into  the  knowledge  base,  s/he  will 
have  the  opportunity  to  suggest  corrections  as  appropriate. 

A  classic  problem  encountered  during  knowledge  engineering  efforts  is 
the  acquisition  of  information  from  multiple  experts.  In  many  cases,  the 
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experts  fail  to  agree  on  important  points  and  the  knowledge  engineer  is  not 
in  a  Dosition  to  judge  the  opinions  of  one  against  the  other.  A  more  seri¬ 
ous  problem  lies  in  the  fact  that  the  mental  model  of  the  domain  varies 
considerably  from  expert  to  expert.  This  is  reflected  in  differences  in 
emphasis  that  are  imparted  to  the  knowledge  engineer  during  the  acquisition 
process.  The  fact  that  one  concept  is  considered  more  important  than 
another  can  have  a  large  effect  on  the  knowledge  base  structure.  Conse¬ 
quently,  knowledge  bases  engineered  from  multiole  experts  can  "look" 
different  from  one  another,  even  though  there  may  be  few  outright 
contradictions. 

KAT  is  being  designed  to  provide  assistance  with  this  problem  to  the 
knowledge  engineer.  3y  providing  facilities  for  experts  to  specify  and 
edit  models  of  the  materials  process,  a  handy  tool  for  observing  differ¬ 
ences  in  emphasis  imparted  by  different  experts  will  be  available.  There 
will  be  opportunities  for  an  expert  to  compare  directly  his  or  her  formu¬ 
lation  of  the  domain  with  that  specified  by  other  experts.  Once  exposed, 
these  disagreements  can  be  resolved  by  revising  one  or  more  of  the  knowl¬ 
edge  structures,  or  at  least  can  be  marked  for  future  reference. 

One  final  class  of  problems  that  KAT  addresses  is  that  of  verifying 
the  knowledge  structure  once  it  is  in  place.  In  normal  practice,  it  is 
sometimes  quite  difficult  to  check  that  the  information  encoded  in  the  sys¬ 
tem  actually  conveys  the  meaning  intended  by  the  expert.  One  way  in  which 
this  problem  will  be  addressed  in  KAT  is  in  the  Diagnosis  Mode.  During 
Diagnosis,  the  expert  will  see  an  automated  step-through  of  the  process  as 
it  has  been  specified  up  to  that  point.  If  all  is  well,  the  process  should 
flow  according  to  the  expert's  expectations.  Deviations  from  those  expec¬ 
tations,  however,  will  indicate  either  that  information  has  been  coded  in 
an  improper  way  or  that  information  is  missing  altogether.  Once  these 
problems  are  detected,  the  expert  can  immediately  direct  their  correction 
on-line.  S/he  can  then  check  to  see  that  proposed  solutions  have  indeed 
eliminated  the  problem  by  re-running  the  step-through. 
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KAT'S  FIRST  APPLICATION  DOMAIN;  CHEMICAL  VAPOR  INFILTRATION 


Although  the  design  of  KAT  is  general  enough  to  he  irnplemented  in  any 
Tiaterials  processing  domain,  the  first  demonstration  will  be  built  in  the 
area  of  Chemical  Vapor  Infiltration  (CVI).  An  extensive  literature  search 
has  been  conducted  to  determine  the  status  of  current  CVI  research  method¬ 
ologies.  After  reviewing  the  pertinent  literature,  attention  was  focussed 
primarily  on  the  work  of  the  Oak  Ridge  National  Laboratory  (Caouto  & 
Lackey,  1984;  Caputo,  Lackey,  i  Stinson,  1985). 

The  objective  of  the  Oak  Ridge  work  has  been  to  produce  composites  by 
first  making  a  ceramic  fiber  preform  and  then  synthesizing  the  ceramic 
matrix  by  infiltrating  this  fibrous  preform  using  a  low  stress,  low  temper¬ 
ature  process  that  would  not  damage  the  high  strength  ceramic  fibers.  Pre¬ 
vious  CVI  work  indicated  that  required  processing  times  have  been  extremely 
long,  sometimes  lasting  several  weeks.  A  goal  of  this  work,  then,  has  been 
to  reduce  processing  times  to  a  matter  of  hours  so  that  composite  costs 
would  be  lowered  sufficiently  to  make  such  materials  cost-effective  for 
engineering  applications. 

As  shown  in  Figure  6,  the  CVI  method  used  at  Oak  Ridge  involves  a  new 
approach  that  combines  the  use  of  the  thermal -gradient  and  pressure  gradi¬ 
ent  processes.  A  critical  portion  of  their  equipment  includes  a  gas- 
injector  and  preform  holder.  A  graphite  preform  holder  is  placed  on  top  of 
a  water-cooled  metal  holder.  The  graphite  holder  is  cooled  sufficiently  by 
contacting  the  water-cooled  metal  holder  to  prevent  deposition  on  the 
bottom  and  side  surfaces.  Reactant  gases  flow  up  through  the  water-cooled 
gas  injector,  through  the  preform,  and  when  the  reactants  are  sufficiently 
heated  (near  the  top  of  the  preform)  the  chemical  vapor  deposition  reaction 
occurs.  Initially,  the  gases  are  able  to  flow  both  axially  and  radially 
through  the  preform.  However,  when  the  top  surface  becomes  coated,  the 
gases  flowing  up  into  the  preform  must  then  flow  radially  through  the  pre¬ 
form  to  the  annular  void  space  around  the  preform,  and  then  escape  through 
the  holes  in  the  retaining  ring.  As  a  result,  the  fibers  are  coated  uni¬ 
formly  in  the  preform,  thus  forming  the  matrix  phase  of  the  composite.  As 
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Fiqure  6.  Example  of  a  Chamber  Used  for  CVI  Using  Thermal  Gradient 
and  Gas  Flow-Through  System  (From  Caputo  and  Lackey,  1984, 
Ceramic  Engineering  Sciences  Proceedings) 
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a  :Tiatrix  deoosition  continues,  the  thermal  conductivity  of  the  infiltrated 
oortions  of  the  preform  increases  and  the  deposition  front  moves  oro- 
qressively  f^'orn  the  too  of  the  preform  toward  the  bottom  and  circumference. 

’’his  initial  characterization  of  the  CVI  process  has  been  taken  from 
Dublished  articles  and  reports.  Important  information  not  included  in  such 
documents  includes  such  things  as:  type  and  location  of  sensors  in  the 
reactor  environment;  heuristic  knowledge  about  interpretation  of  these 
sensor  '■eadings;  and  diagnosis  of  ‘^inal  products  to  determine  process 
redesign.  In  order  to  gain  some  insight  into  these  areas,  BOM  personnel 
have  visited  Caputo's  lab  at  Oak  Ridge  and  have  attended  conferences  on 
CVI.  Information  obtained  from  these  and  other  interactions  will  be  used 
to  help  design  the  initial  implementation  of  the  KAT  system. 

0.  INITIAL  IMPLEMENTATION  OF  KAT 

KAT  is  being  built  at  BDM  on  a  Symbolics  3670  machine  in  the  KEE  and 
SIMKIT  environments.  KEE  is  an  expert  system  building  shell  sold  by 
Intellicorp.  It  provides  many  facilities  to  aid  AI  programmers  in  the 
generation  of  frame-like  objects  and  rules.  In  addition,  it  has  graphics 
and  specialized  mouse  functions  which  are  useful  in  constructing  user 
interfaces.  The  SIMKIT  system,  which  resides  on  top  of  KEE,  provides  a 
host  of  facilities  for  writing  event-driven  simulations,  including  a  clock, 
event  calendar,  data  collectors,  and  various  mathematical  tools  for  data 
analysis.  The  event-driven  nature  of  the  SIMKIT  simulation  environment 
makes  it  ideal  for  the  materials  processing  domain. 

The  following  is  a  brief  description  of  the  features  being  implemented 
in  KAT  using  both  functions  available  from  the  KEE  and  SIMKIT  environments 
as  well  as  other  code  generated  at  BDM.  Some  of  these  features  have 
already  been  implemented,  and  others  are  currently  being  designed.  Speci¬ 
fically,  BOM  has  completed  versions  of  the  CVI  Library  and  the  Clarifica¬ 
tion  Mode.  The  Prediction  Mode  is  partially  completed  at  this  point.  The 
next  infiplementation  efforts  will  be  directed  toward  completing  the  Predic¬ 
tion  Mode  and  implementing  a  first  version  of  the  Diagnosis  Mode. 
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1 .  The  CVI  Library 

Before  one  can  build  a  process  model  in  SIMKIT,  a  library  must 
first  be  constructed  which  contains  all  objects  and  rule  classes  that  will 
be  used  in  the  final  system.  The  review  of  the  CVI  literature  conducted  by 
BOM  has  provided  a  oreliminary  set  of  objects  with  which  a  library  has  been 
constructed.  As  shown  in  Figure  7,  such  objects  include  reactor  types, 
preform  types,  information  about  thermal  and  pressure  gradients,  etc.  For 
each  of  these  objects,  further  information  may  be  stored  in  internal 
"slots".  For  instance,  the  object  corresponding  to  a  one-dimensional 
fibrous  preform  might  have  slots  for  such  features  as  size,  material 
takeup,  initial  density,  optimum  density,  and  reactive  gas,  to  name  a  few. 
Each  of  these  slots  is  allowed  to  take  on  certain  values.  These  values  can 
be  set  and  reset  for  any  particular  materials  design  scenario. 

The  aim  in  constructing  this  initial  library  has  not  been  to 
represent  exhaustively  every  element  of  interest  in  the  CVI  process.  That 
task  will  be  left  to  the  domain  expert  when  KAT  is  actually  used  to  build 
the  CVI  knowledge  base.  Rather,  the  intent  is  to  anticipate,  to  a  certain 
degree,  some  general  concepts  that  are  needed  to  describe  the  CVI  process. 
These  basic  components  will  then  be  in  place  in  the  system  when  the 
knowledge  engineer  and  the  expert  sit  down  for  the  first  time  to  create  a 
CVI  model.  Building  this  initial  library  will  not  only  save  the  expert 
time,  but  will  provide  some  guidance  for  the  expert's  early  efforts  in  par¬ 
titioning  the  CVI  world  into  objects. 

2.  The  Clarification  Mode 

The  expert's  task  in  the  Clarification  Mode  is  to  create  an 
ANO/OR  graph  of  the  CVI  process.  At  the  outset  of  this  mode,  certain 
objects  corresponding  to  units  in  the  CVI  library  are  available  in  an 
object  window  (see  Figure  8).  If  the  expert  wishes,  new  objects  not 
already  in  the  library  can  be  created  at  any  time  and  placed  in  this  object 
window.  The  expert  indicates  that  a  particular  object  should  be  moved  into 
the  main  viewport  and  included  in  the  AND/OR  graph.  When  the  corresponding 
icon  is  moused  in  the  object  window,  a  menu  will  appear  displaying  the 
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slots  and  values  of  that  object  before  its  olacement  in  the  viewoort  is 
confirmed. 

Once  several  objects  are  in  olace  in  the  viewoort,  the  expert  can 
indicate  the  type  of  i^elation  that  should  exist  between  them.  These 
relations  include  AND,  OR,  and  NEXT,  and  are  displayed  in  the  relations 
window  below  the  viewport.  'Note  that  other  relations  are  displayed  as 
well.  While  not  used  durinq  Clarification,  these  are  of  interest  in  the 
Prediction  Mode.)  The  user  mouses  on  the  desired  relation,  and  then  mouses 
on  the  objects  to  be  linked  with  that  relation.  The  system  will  then 
orompt  for  other  objects  to  be  included  in  the  relation,  and  the  final  con¬ 
figuration  will  be  displayed  with  arrows  indicating  relations  that  have 
been  defined  between  objects.  This  graph  creation  will  continue  until  the 
expert  has  thoroughly  specified  the  CVI  process. 

3.  The  Prediction  Mode 

The  information  entered  into  the  system  during  the  Clarification 
Mode  is  converted  into  a  flowchart  representation  before  being  shown  again 
in  the  'Prediction  Mode  (see  Figure  9).  Code  has  been  generated  which 
collapses  AND  and  OR  tree  structures  down  into  single  composite  objects. 
These  composite  objects  are  displayed  with  simple  "next"  relations  in  the 
flowchart  format,  thus  emphasizing  the  temporal  flow  of  the  process. 

For  each  subprocess  point  in  the  flowchart,  the  expert  will  be 
asked  which  sensors  are  relevant  and  what  their  normal  ranges  should  be. 
In  addition,  the  expert  is  asked  questions  concerning  his  or  her  inter¬ 
pretation  of  extreme  sensor  readings  at  each  subprocess  point.  The  expert 
is  asked  what  very  high  or  very  low  readings  would  indicate  at  this  point 
in  the  process.  The  responses  to  such  queries  will  take  the  form  of  rules. 
For  example,  the  expert  might  say,  "If  the  temperature  of  the  reactive 
chamber  is  greater  than  1200  degrees,  then  the  infiltration  of  the  preform 
will  be  uneven."  This  identification  of  potential  problems  in  the  Pre¬ 
diction  Mode  will  likely  prompt  the  expert  to  redesign  the  process  in  some 
cases.  Thus,  facilities  for  rearranging,  adding,  deleting,  and  creating 
new  objects  are  also  available  during  the  Prediction  Mode. 
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The  task  of  handling  free-form  user  inputs  and  converting  them 
into  acceptable  rule  form  is  a  complex  one.  There  are  many  problems  to 
consider,  such  as  how  to  have  multiple  antecedents  and  consequents,  how  to 
handle  variables  in  rules,  how  to  choose  from  among  the  several  rule  types 
available  in  the  KEE  system,  and  how  to  incorporate  newly  created  rules 
into  the  already-existing  knowledge  structure.  To  address  these  problems, 
a  menu-driven  facility  is  being  designed  that  will  handle  the  construction 
of  rules  in  a  partially  automated  manner.  In  its  early  version,  the  rule 
builder  will  by  used  by  the  knowledge  engineer  to  construct  standard 
If-Then  rules  that  conform  to  the  syntax  dictated  by  KEE.  Later,  facili¬ 
ties  will  be  added  for  constructing  LISP  expressions  and  methods. 

Once  the  expert  has  been  queried  about  each  subprocess  in  the 
flowchart,  the  knowledge  engineer  will  return  to  the  Clarification  Mode. 
In  the  Clarification  Mode,  the  knowledge  structure  will  again  be  presented 
in  an  AND/OR  format  and  the  expert  will  further  specify  the  process.  It  is 
expected  that  switching  between  the  AND/OR  graph  and  the  flowchart  displays 
will  prompt  the  expert  to  think  of  details  to  add  to  the  model  created  up 
to  that  point.  These  details  might  not  be  remembered  if  the  model  was 
always  presented  in  one  format. 

4.  The  Diagnosis  Mode 

The  system  features  described  thus  far  have  already  been  imple¬ 
mented  or,  in  the  case  of  the  rule  builder,  are  currently  being  imple¬ 
mented.  In  this  section  a  design  for  the  Diagnosis  Mode  is  presented,  in 
addition  to  the  technical  issues  to  be  addressed  in  its  development. 

Once  the  knowledge  engineer  has  iterated  through  the  Clarifica¬ 
tion  and  Prediction  Modes  several  times  with  the  expert,  a  good  deal  of 
information  about  how  the  process  occurs  will  be  represented  in  the  know¬ 
ledge  structure.  In  the  Diagnosis  Mode,  the  expert  will  have  a  chance  to 
look  at  a  step-through  simulation  of  the  process.  Specialized  graphics 
will  have  been  created  earlier  in  the  Prediction  Mode  for  displaying  sensor 
readouts  at  this  time  (see  Figure  10).  In  addition,  the  expert  will  be 
able  to  observe  directly  the  consequences  of  any  process  rules  defined 
during  the  Prediction  Mode.  If  at  any  time  the  expert  perceives  the 
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process  to  be  going  awry,  s/he  can  stoo  it  immediately  and  redesign  as 
necessary.  Such  redesign  could  include  any  number  of  measures  such  as 
adding,  deleting,  or  rearranging  sensors,  rules,  or  objects. 

Note  that  the  form  of  query  in  the  Diagnosis  Mode  is  more 
implicit  than  in  the  previous  modes.  There  is  no  program  of  queries  to 
which  particular  types  of  responses  are  expected.  The  expert  is  not  being 
given  direct  questions  about  the  structure  of  the  process.  Rather,  s/he  is 
allowed  to  observe  a  step-through  simulation  as  defined  by  information  pro¬ 
vided  thus  far,  and  make  determinations  about  how  this  design  could  be 
improved.  Note  also  that  the  term  "simulation"  is  not  being  used  in  the 
traditional  sense.  Rather,  it  refers  to  a  facility  in  which  a  progression 
of  previously  defined  states  is  displayed  through,  among  other  things, 
changes  in  sensor  icons.  In  order  to  have  a  true  simulation  of  the  CVI 
process,  one  would  first  need  a  structural  model  on  which  to  build.  Such  a 
model  may  indeed  be  the  final  output  of  KAT,  but  would  not  be  specified  by 
the  knowledge  structure  at  this  point. 


E.  APPLYING  KNOWLEDGE  ENGINEERING  TO  SOFTWARE  ENGINEERING 
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Having  completed  the  initial  design  and  some  of  the  initial  implemen¬ 
tation  of  KAT  in  a  materials  processing  domain,  BDM  is  exploring  the  possi¬ 
bilities  of  KAT's  application  in  other  unrelated  areas.  In  the  most 
general  sense,  KAT  should  be  a  useful  tool  in  any  domain  embodying  process 
knowledge.  These  domains  vary  widely  and  might  include  materials 
selection,  factory  automation,  planning,  etc.  One  potential  application 
area  that  appears  to  hold  a  great  deal  of  promise  is  that  of  software  engi¬ 
neering.  In  the  remaining  sections  of  this  report,  software  engineering  is 
defined  and  the  ways  in  which  it  could  benefit  from  a  tool  such  as  KAT  are 
discussed. 


1.  Process  Knowledge  and  Programming 

The  enterprise  of  software  engineering  is  dedicated  to  creating 
programming  methodologies  and  environments  that  facilitate  the  development 
of  maintainable  and  verifiable  software.  A  critical  determinant  in  the 
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design  of  tools  to  aid  the  software  engineer  is  how  the  software  engi¬ 
neering  activity  itself  is  conceptualized.  Programming  has  traditionally 
been  regarded  as  a  problem  solving  activity.  Thus,  software  engineering 
emphasis  has  often  been  on  developing  software  aimed  at  solving  particular 
classes  of  problems,  even  in  cases  where  the  applications  do  not  fit  our 
idea  of  a  problem. 

In  contrast  to  this  view  of  programming  as  problem  solving,  there 
is  a  novel  way  of  viewing  both  the  structure  of  programs  and  the  structure 
of  software  engineering.  Specifically,  a  computer  program  can  be  viewed  as 
the  specification  of  a  process.  The  idea  that  a  program  specifies  a 
process  does  not  seem  radical  and  may  seem  implicit  in  certain  types  of 
programming  such  as  simulations.  Nevertheless,  it  represents  a  shift  in 
emphasis  from  the  tradition  of  a  program  as  describing  a  problem  solving 
method.  Processes  may  be  problem  solving  activities,  but  they  may  be  many 
other  things,  including  real-time  control  and  operating  systems.  For 
instance,  many  of  the  examples  cited  as  "components  of  complex  systems"  by 
Winograd  (1979)  are  most  easily  conceptualized  as  processes  or  as 
behavioral  descriptions  of  systems,  rather  than  as  problem  solving 
activities. 

Once  the  model  of  programs  as  processes  is  accepted,  the  software 
engineering  researcher's  task  becomes  one  of  studying  and  providing  facili¬ 
ties  for  the  specification  of  processes  in  a  disciplined  and  natural 
manner.  Since  KAT  is  specifically  designed  to  provide  an  environment  for 
the  acquisition  of  process  knowledge,  it  should  be  most  helpful  in  this 
regard.  KAT  is  being  built  using  important  principles  of  software  engi¬ 
neering,  but  it  is  also  clear  that  the  techniques  embodied  in  KAT  for 
knowledge  engineering  can  be  fed  back  into  the  design  of  programming 
environments  for  software  engineering. 

If  one  thinks  of  programming  as  process  specification  rather  than 
problem  solving,  the  techniques  developed  in  KAT  for  the  acquisition  of 
process  knowledge  are  available  for  use  in  creating  good  programming 
environments.  The  basic  entities  by  which  processes  are  described  in  KAT 
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include  the  lowest  level  subprocesses  and  the  structures  that  are  refer¬ 
enced  in  the  description  of  the  process  at  any  level.  In  using  KAT  to 
develop  software  specifications  for  programming  a  process,  natural  language 
descriptions  of  subsystems  known  to  be  programmable  would  constitute  these 
lowest  level  items.  If  KAT  were  being  used  to  produce  code  directly,  there 
would  be  statements  in  a  programming  language  or  modules  already  available. 

There  should  be  present  in  the  software  engineering  environment  a 
variety  of  statements  of  a  functional,  imperative,  and  declarative  nature 
that  can  perform  the  desired  operations.  It  should  be  possible  to  create 
new  ones  within  the  environment  by  compositions  of  processes  and  by  defini¬ 
tion  of  basic  processes  on  data  structures. 

Additional  basic  entities  in  software  engineering  are  the  data 
structures  used  in  programming.  In  current  software  engineering  method¬ 
ology,  they  are  described  by  data  abstraction  techniques.  In  fact,  this  is 
exactly  how  their  counterparts  in  knowledge  engineering  are  described.  For 
instance,  in  a  navy  knowledge-based  system  in  which  reference  is  made  to 
ships,  the  system  only  knows  what  a  ship  is  in  terms  of  the  operations  that 
can  take  place  on  ships  and  the  predicates  that  can  be  used  to  make  queries 
about  ships.  A  ship  is  a  different  data  object  in  a  system  for  naval 
personnel  records  than  in  a  system  for  naval  battle  management. 

2.  Specific  Areas  of  Tool  Application 


Suppose  that  the  whole  process  of  creating  software  for  a  par¬ 
ticular  application  were  developed  using  a  tool  such  as  KAT.  At  the  very 
least,  one  could  use  the  tool  for  recording  and  refining  specifications  for 
the  system,  and  project  assignments  could  be  imposed  over  this  structure. 
The  description  of  the  system  could  be  developed  by  individuals  or  software 
engineering  teams,  down  to  the  level  of  code.  Specification,  code,  and 
documentation  could  be  kept  together,  thus  simplifying  the  project 
librarian's  job. 

In  addition,  one  could  use  KAT's  facilities  for  creating  AND/OR 
and  flowchart  representations  of  a  process  to  add  to  the  documentation. 
Further,  one  might  imagine  that  KAT's  Prediction  Mode  queries  such  as  "What 
could  go  wrong  here?"  and  "How  could  the  process  be  redesigned  to  avoid 
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this  problem?"  would  be  helpful  in  fleshing  out  program  content,  making 
programs  "correct  by  design".  Finally,  the  ability  to  "step  through"  a 
program  in  KAT's  Diagnosis  Mode  would  provide  an  ideal  facility  for 
debugging. 

The  ways  in  which  a  tool  such  as  KAT  might  be  applied  to  software 
engineering  efforts  extend  far  beyond  these  specific  examples.  Below  are 
listed  seven  generic  problem  areas  of  concern  to  software  engineers  that 
could  be  aided  through  techniques  developed  for  knowledge  engineers: 

a.  Code  Design 

This  is  the  primary  issue  addressed  previously.  Generation 
of  code  could  take  place  automatically  through  the  specification  of 
processes,  just  as  knowledge  bases  can  be  automatically  generated  with  KAT. 

b.  Project  Design 

In  a  large  software  project,  the  organization  of  the  project 
reflects,  to  some  degree,  the  organization  of  the  system.  How  better  to 
determine  system  segmentation  than  through  gathering  the  expertise  of 
persons  with  knowledge  of  the  process  for  which  the  software  is  being 
designed?  Once  this  information  about  the  hierarchical  project  design  is 
obtained,  it  can  be  made  available  to  those  managing  the  project  who  need  a 
big  picture  view.  Given  an  appropriate  knowledge  acquisition  tool  with  a 
knowledge  base  that  can  be  consulted  centrally,  managers  and  domain  experts 
alike  can  add  comments  pertinent  to  the  project  design. 

c.  Interteam  and  Intrateam  Communication 

Any  sort  of  computerized  tool  for  project  segmentation  can 
facilitate  communication  within  and  among  programming  teams.  This  is 
analogous  to  the  sharing  of  opinions  among  experts  and  AI  programmers 
through  the  use  of  a  knowledge  engineering  tool  such  as  KAT. 

d.  Problem  Diagnosis 

As  mentioned  earlier,  a  facility  such  as  the  Diagnosis  Mode 
serves  a  very  important  debugging  function.  Such  a  feature  would  provide 
programmers  with  an  opportunity  to  observe  the  consequences  of  having 
specified  the  program  flow  in  a  particular  way,  and  to  embellish  or 
redesign  as  necessary. 
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e.  External  Documentation 

Imagine  that  one  could  couple  knowledge  acquisition  as  it 
continues  through  the  development  project  with  an  expert  system  shell  such 
as  the  KEE  system  used  in  KAT.  It  would  then  be  possible  to  develop  effec¬ 
tive  reference  systems  that  anticipate  and  react  to  a  user's  needs,  rather 
than  producing  canned  documentation.  This  would  be  useful  for  many 
purposes,  including  tutoring  new  users. 

f .  Redesign  and  Reuse 

By  archiving  the  knowledge  concerning  the  software  design 
process,  it  should  be  possible  to  facilitate  the  maintenance,  redesign,  and 
reuse  of  the  modules  in  the  program.  The  importance  of  internal  documenta¬ 
tion  to  this  process  has  often  been  remarked.  The  sophisticated  history 
gathered  by  KAT  should  be  doubly  useful  in  this  process.  Representational 
aspects  of  KAT,  including  class  hierarchies  and  instance  variables,  tend  to 
promote  reuse  and  redesign.  As  Fischer  (1987)  points  out,  inheritance 
allows  simple  redesign  by  allowing  new  objects  similar  to  ones  previously 
defined  to  be  created  with  only  a  few  incremental  changes.  Inheritance 
also  reduces  the  need  to  specify  redundant  information,  and  simplifies 
updating  and  modification. 

g.  Testing  and  Verification 

As  an  aid  to  software  engineering,  it  has  long  been  con¬ 
sidered  useful  to  provide  interpreters  that  can  simulate  the  execution  of 
code  in  a  production  environment,  thus  helping  to  test  that  code.  There  is 
also  the  possibility  of  verification  of  the  code,  either  heuristically, 
with  relevant  "expertise"  built  into  the  software  engineering  system,  or 
through  mathematical  techniques  such  as  the  inductive  assertion  method 
(e.g.,  Floyd,  1967;  Hoare,  1969). 

In  summary,  KAT  is  designed  for  use  in  knowledge  engi¬ 
neering,  specifically  in  acquiring  expert  knowledge  about  processes.  If 
one  considers  computer  programming  as  the  specification  of  processes,  KAT 
has  excellent  potential  as  a  software  engineering  tool  as  well.  As  the 
development  of  KAT  progresses,  BDM  will  continue  to  explore  application 
areas  other  than  materials  processing  where  it  might  be  usefully  employed. 
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